S3Drive - Uploading a big file duplicates the folder

When uploading a big file duplicates the folder where you're uploading the file.

I believe this may happen if folder inside mixes both encrypted and unencrypted files. We don't have any immediate solution other than introduce vaults: https://s3drive.canny.io/feature-requests/p/rclone-configuration-support-encrypted-vaults which won't mix unencrypted data with encrypted, but will allow setting up encrypted only or unencrypted only data.

Tom

I believe this may happen if folder inside mixes both encrypted and unencrypted files. We don't have any immediate solution other than introduce vaults: https://s3drive.canny.io/feature-requests/p/rclone-configuration-support-encrypted-vaults which won't mix unencrypted data with encrypted, but will allow setting up encrypted only or unencrypted only data.

I thought they are encrypted before sent? Also while uploading a file and the folder duplicates again, If you open one of the folder it duplicates it permanently. The other one has no files and the other one has the uploaded.

I2rys (安全)

I thought they are encrypted before sent? Also while uploading a file and the folder duplicates again, If you open one of the folder it duplicates it permanently. The other one has no files and the other one has the uploaded.

I am not exactly sure if that's what's happening on your end right now, but if there was a folder consisting file(s) before name encryption was enabled, then after enabling encryption and uploading a file to a folder, technically it will be uploaded to a new folder, even though after name decryption it looks like the same entry. After folders get duplicated on screen, once you refresh page, does both entry stay or only one is displayed?

Tom

I am not exactly sure if that's what's happening on your end right now, but if there was a folder consisting file(s) before name encryption was enabled, then after enabling encryption and uploading a file to a folder, technically it will be uploaded to a new folder, even though after name decryption it looks like the same entry. After folders get duplicated on screen, once you refresh page, does both entry stay or only one is displayed?

Nope there wasn't but thank you for the insight and yeah both entry stay like it gets duplicate. I have tried both on mobile and PC (Windows 10)

10:14 PM

But the folder is empty (edited)

Quick question, what's S3 provider here? Does issue affect other S3 providers?

Sorry to ask, but can you reproduce this reliably? This isn't I can reproduce on my end. I would appreciate if you could provide some steps. If this happens for big files, then in some ways may be related to Multipart upload (if enabled, the start threshold is 100MB).

Tom

Quick question, what's S3 provider here? Does issue affect other S3 providers?

It's iDrive E2 and yes It does affect other providers. After reproducing the problem multiple times it turns out It happens everytime a file is uploaded thus If you upload multiple files you can reproduce this issue. (edited)

We've tried to reproduce it with these: https://discord.com/channels/1069654792902815845/1260138245237510176/1260870150635261952 but it doesn't seem to work for us. Uploading big file on its own won't duplicate a folder. You say:

it turns it It happens everytime a file is uploaded

I assume that whilst you wait for big file to upload you then either browse directory tree or perform some other operations, which is obviously expected. I am sorry to ask, but are you able to provide us step by step the scenario when this bug happens, e.g.: a) Folder: MyFiles is opened, containing: Images folder. b) Using drag&drop, dropped local folder: Holidays on Images folder. ... and so on.

8:18 AM

In the meantime we will be trying to reproduce this on our own.

8:22 AM

Actually it seems we've managed to reproduce it once, but going inside the folder and outside couple times. We'll try to find the cause and fix in a next release. Thanks !

I assume that whilst you wait for big file to upload you then either browse directory tree or perform some other operations, which is obviously expected.

The only extra operation I did was refresh in the folder root directory. And np! catdance

I2rys (安全)

I assume that whilst you wait for big file to upload you then either browse directory tree or perform some other operations, which is obviously expected.

The only extra operation I did was refresh in the folder root directory. And np! catdance

We've found an issue where uploading multiple files in a folder and then either refreshing or going in/out folder duplicates the folder, but it's only a display view which goes away after refresh. This will be fixed in a next release. However you've also mentioned:

Also while uploading a file and the folder duplicates again, If you open one of the folder it duplicates it permanently. The other one has no files and the other one has the uploaded.

which we haven't replicated really. I will let you know once we've released a fix and then perhaps if you come across on this issue again you could let us know. Thanks! (edited)

1